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(57) ABSTRACT 

A graphical user interface (GUI) allows a user to directly 
access items of visual and/or audio media by passing a 
cursor over points on an electronic map. Indicators in the 
form of icons representing media items can be displayed and 
can be accessed through a media viewer. A determination is 
made whether a position indicator or pointer, such as a 
cursor, is located proximate to a GUI location that is 
associated with supplemental content in the form of a media 
item. If so, an indicator is presented to advise the user that 
supplemental content is indeed associated with that location 
on the interface. For example, a media icon representing one 
or more media items can be displayed on the output device 
proximate to the location of the input device indicator. This 
indicator serves as a prompt or cue for the user to select the 
indicator if the user desires to review the supplemental 
content. A determination is made whether the media icon has 
been selected in response to an input signal issued by an 
input device. If so, the selected media item, typically video 
and/or audio information, is presented to the user via the 
output device. 

19 Ciaims, 6 Drawing Slieets 
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SYSTEM AND METHOD FOR DISPLAYING SUMMARY OF THE INVENTION 

MEDIA INTERACTIVELY ON A VmEO ^h, ^^^^^^^^ ^^Ivcs the aforementioned prob- 

DISPLAY DEVICE j^j^j^ existing in the prior art by providing an interactive 

interface between a user and graphical user interface for 

TECHNICAL FIELD ^ presenting electronic content, such as a geographical map. 

For example, the present invention can support the prescn- 

The present invention relates to interactive electronic tation of a scalable interactive geographic map having 

maps. More specifically, the invention relates to an intcrac- selectable content associated with map locations. The map 

live map that allows users to display different items of visual can be scaled from a global view down to view of individual 

and/or audio media corresponding to a location on the cities and towns. At any point along this scale, the user can 

geographic map. interact with the map and be presented with media associ- 
ated with locations on the map. The present invention can be 

BACKGROUND OF THE INVENTION ^^j^^ed with a variety of graphical content presented in an 

As computer technology has advanced, atlases have been electronic format, including road maps, photographs, or 

published in electronic form. These electronic aUases make other types of graphical user interfaces, 

it possible to include vast amounts of information on a few The present invention supports the presentation of media 

compact discs (or CD-ROMs). This information includes items interactively via an output device, such as a video 

electronic maps and items of visual and/or audio media. display device for a computer. The present invention allows 

Although the advent of electronic aliases has made such a user to interact with a geographic map to facilitate access 

media more accessible and the relationship between clec- to content associated with locations of the electronic map, 

tronic maps and such media more direct and interconnected, including items of visual and/or audio media. For example, 

the prior art did not provide users with an cfBcient mecha- a user can use an input device, such as a mouse, to pass a 

nism for easily locating and associating such media with position indicator presented in the conventional form of a 

electronic maps. cursor over an electronic geographic map. In the alternative. 

To allow users to more easily associate such media with the user can use one or more keyboard commands to move 

electronic maps, one prior art electronic atlas provided a the position indicator to a selected location on the electronic 

limited level of association between visual and/or audio map. If the cursor passes within a pre-selected distance of a 

media and electronic maps. For example, prior art atlases predetermined point on the map that is associated with at 

have displayed representations of certain types of visual 3Q least one media item, the user can be presented each media 

media directly on the face of an electronic map. This allowed icon representing available media items at that location. The 

a user to view the media on a pre -determined location upon user can then pass the cursor over a displayed media icon 

the face of the map. Although this adas was useful, the and directly access the media item by selecting the media 

media content and map were not interactive and supported icon with a "click" of a mouse button. In this manner, the 

the use of limited quantity, variety and types of media. 35 user can access an expanded version of a selected visual 

In another prior art aUas, media icons were displayed media item, play and replay a selected audio media item, and 

upon the face of an electronic map when the user passed a select hyperlinks associated with related content, 

input device position indicator, such as a cursor, over A user can interact directly with the geographic map to 

locations on the map with which a media item or items had access media items, such as graphic and text-based visual 

been associated or linked. The user could then access a 40 media and audio media without the necessity to access the 

full-size or complete version of the media item by selecting media through the indirect use of a dialog box or other 

the location, typically by using an input device to issuing an device. This interaction allows a user to select a location on 

input signal, and opening a separate window, such as a the geographic map and to be presented with media items 

dialog box. Selecting the item via the dialog box presented that are associated with the specific, chosen location and 

to the user accesses the desired media item. Although such 45 those items associated with locations within a predetermined 

electronic maps were interactive, these prior maps allowed distance thereof. Further, the present invention allows a user 

a user only to see media representations from an exact to customize the interactive nature of the invention by 

location, e.g., within a few pixels of the cursor, at the same filtering and/or restricting the type and categories of media 

time. Moreover, the prior electronic maps only allowed the with which the user will be presented during their interaction 

user to access the full-size or complete media item indirectly 50 with the map. Due to limits in computing power of machines 

by selecting the media item from within a dialog box or used by particular users, the present invention can present 

other tabular form. In addition, such electronic maps did not media in an efficient manner that provides a user with the 

provide the user with any abiUty to filter or restrict the type perception that the invention is responding quickly to the 

of visual and/or audio media that the user could locate by user's inputs. For example, the amount of media available 

interacting with the electronic map. 55 for presentation at a chosen location on the map can be 

Cbnsequently, there is a need in the art for an electronic restricted when a user*s computer has a slower processing 

atlas that provides a direct interface to visual and/or audio speed. This restriction is performed in a manner that is not 

media through an interactive electronic map. Moreover, perceived by the user and, ultimately, provides the user with 

there is a need for an electronic map that provides a user with ^he perception that the invention is responding quickly to the 

direct access to large amounts of media at the same (or a 60 ^ uip^^s. 

very short) time period and over a larger area of an electronic gj^j^p DESCRIPTION OF THE DRAWINGS 
map. As a result of such increased access to media, there is 

a corresponding need for the ability to filter or restrict the FIG. 1 is a block diagram of a personal computer that 

type of media that a user can locate by interacting with an provides an exemplary operating environment for the 

electronic map. Also, as a result of such increased media 65 present invention. 

access, there is a corresponding need for retrieving and FIG. 2 is an exemplary display screen of a software 

displaying such media in an efficient manner. program that illustrates the display of a media icon in 
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response to a selection of a location on an electronic Although the preferred embodiment will be generally 

geographic map. described in the context of a program and an operating 

HG. 3 is an exemplary display screen of a software system running on a personal computer, those skilled in the 

* n » ♦ « ;r„«^« art Will recocnize that the present mvention also can be 

program that illustrates the display of a full-size image or an . , .9 • j i c 

f • 1 ^' • o ^« s implemented in conjunction with other program modules for 

item of visual media in direct response to a user cucKing on ^ t: . r * *i- i -n j- 

. , . , ^. ^ other types of computers. Furthermore, those skilled in the 

a visual media icon on an electronic ceograpnic map. ^ '^\ ■ «u * *u * * *• u i 

B 6 r f recognize that the present invention may be imple- 

FIG. 4 is a logic flow diagram illustrating an exemplary menlcd in a stand-alone or in a distributed computing 
process for displaying media items interactively upon a environment. In a distributed computing environment, pro- 
video display device. gram modules may be physically located in different local 

FIG. 5A is a logic flow diagram illustrating an exemplary and remote memory storage devices. Execution of the pro- 

process for identifying and retrieving media items into a gram modules may occur locally in a stand-alone manner or 

computer for the purpose of displaying such items on a video remotely in a client/server manner. Examples of such dis- 

display device. tributed computing environments include local area net- 

FIG. 5B is a logic flow diagram illustrating an exemplary 55 works of an offlce, enterprise-wide computer networks and 

process for identifying and retrieving media items into a the global Internet. 

computer for the purpose of displaying such items on a video In addition, it should be understood that the programs, 

display device. processes, methods, etc., described herein are not related or 

limited to any particular computer or apparatus, nor are they 

DETAILED DESCRIPTION OF THE related or limited to any particular communication network 

EXEMPLARY EMBODIMENTS architecture. Rather, various types of general-purpose 

The present invention supports the presentation of media machines may be used with program modules constructed in 

items interactively via an output device, such as a video accordance with the teachings described herein. Similarly, it 

display device for a computer. The present invention allows may prove advantageous to construct a specialized apparatus 

a user to interact with a graphical user interface ("GUI"), 25 to perform the computer-supported processes described 

such as a geographic map, to facilitate access to content herein by way of dedicated computer systems in a specific 

associated with locations of the electronic map, including network architecture with hardwired logic or programs 

items of visual and/or audio media. For example, a user can stored in nonvolatile memory, such as read-only memory, 

use an input device, such as a mouse, to pass a position Referring now to the drawings, in which like numerals 

indicator presented in the conventional form of a cursor over 30 represent like elements throughout the several figures, 

an electiDnic geographic map. In the alternative, the user can aspects of the present invention and the preferred operating 

use one or more keyboard commands to move the position environment will be described. FIG. 1 illustrates various 

indicator to a selected location on the electronic map. If the aspects of the preferred computing environment in which the 

cursor passes within a pre-selected distance of a predeter- present invention is designed to operate. Those skilled in the 

mined point on the map that is associated with at least one 35 art will appreciate that FIG. 1 and the associated discussion 

media item, the user can be presented each media icon are intended to provide a brief, general description of the 

representing available media items at that location. The user preferred computer hardware and program modules, and that 

can then pass the cursor over a displayed media icon and additional information is readily available in the appropriate 

directly access the media item by selecting the media icon programming manuals, user's guides, and similar publica- 

with a "click" of a mouse button. In one exemplary 40 tions. FIG. 1 illustrates a conventional personal computer 10 

embodiment, the media items are presented through the use suitable for supporting the operation of an exemplary 

of a window frame on a video display device in the form of embodiment of the present invention. As shown in FIG. 1, 

a media viewer. Using the media viewer, the user can access the personal computer 10 operates in a networked environ- 

an expanded version of a selected visual media item, play ment with logical connections to a remote computer 11. The 

and replay a selected audio media item, and select hyper- 45 logical connections between the personal computer 10 and 

links associated with related content. the remote computer 11 are represented by a local area 

The present invention also can support the creation of a network (LAN) 12 and a wide area network (WAN) 13. In 

perception by the user that a processor operating at a this client/server configuration, the remote computer 11 may 

relatively slow processing speed is fully responsive to function as a file server or computer server, 

commands to present desired electronic content. For one 50 The personal computer 10 includes a central processing 

exemplary embodiment, a threshold boundary is positioned unit (CPU) 14, such as "PENTIUM" microprocessor manu- 

proximate to and surrounds each electronic map location. In factored by Intel Corporation of Santa Clara, Calif. The 

the event that the cursor crosses this threshold boundary, an personal computer also includes system memory 15 

icon representing content for a media item is presented to the (including read-only memory (ROM) 16 and random access 

user. The distance separating the threshold boundary from ss memory (RAM) 17), which is connected to the CPU 14 by 

the electronic map location can be reduced when a deter- a system bus 18. The preferred computer 10 utilizes a BIOS 

mination is made that the computer operates at a relatively 19, which is stored in ROM 16. Those skilled in the art will 

slow processing speed. This reduction is the threshold recognize that the BIOS 19 are a set of basic routines that 

distance to the electronic map location supports the presen- helps to transfer information between elements within the 

tation of an icon representing a media item only when the 60 personal computer 10. Those skilled in the art will also 

cursor is placed on or adjacent to that location. In addition, appreciate that the present invention may be implemented on 

two sets of software instructions can operate through multi- computers having other architectures, such as computers 

tasking to structure the identification and retrieval of media that do not use a BIOS, and those that utilize other types of 

items. This multi -tasking thread architecture can create the microprocessors. 

perception by a user that media items are available shortly 65 Within the personal computer 10, a local hard disk drive 

after the user places the cursor proximate to an electronic 20 is connected to the system bus 18 via a hard disk drive 

map location having associated media items. interface 21. A floppy disk drive 22, which is used to read or 
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write a floppy disk 23, is connected to the system bus 18 via 
a floppy disk drive interface 24. A DVD/CD-ROM drive 25, 
which is used to read a DVD or CD-ROM disk 26, is 
connected to the system bus 18 via a DVD/CD-ROM 
interface 27. A user enters commands and information into 
the personal computer 10 by using input devices, such as a 
keyboard 28 and/or pointing device, such as a mouse 29, 
which are connected to the system bus 18 via a serial port 
interface 30. Other types of pointing devices (not shown in 
FIG. 1) include track pads, track balls, pens, head trackers, 
data gloves and other devices suitable for positioning a 
cursor on a computer monitor 31. The monitor 31 or other 
kind of display device is connected to the system bus 18 via 
a video adapter 32. 

The remote computer 11 in this networked environment is 
connected to a remote memory storage device 33. This 
remote memory storage device 33 is typically a large capac- 
ity device such as a hard disk drive, DVD/CD-ROM drive, 
magneto-optical drive or the like. The personal computer 10 
is connected to the remote computer 11 by a network 
interface 34, which is used to communicate over the local 
area network 12. 

As shown in FIG. 1, the personal computer 10 is also 
connected to the remote computer 11 by a modem 35, which 
is used to communicate over the wide area network 13, such 
as the global Internet. The modem 35 is connected to the 
system bus 18 via the serial port interface 30. The modem 35 
also can be connected to the public switched telephone 
network (PSTN) or community antenna television (CATV) 
network. Although illustrated in FIG. 1 as external to the 
personal computer 10, those of ordinary skill in the art will 
quickly recognize that the modem 35 may also be internal to 
tiie personal computer 11, thus communicating directly via 
the system bus 18. It is important to note that connection to 
the remote computer 11 via both the local area network 12 
and the wide area network 13 is not required, but merely 
illustrates alternative methods of providing a communica- 
tion path between the personal computer 10 and the remote 
computer 11. 

Although other internal components of the personal com- 
puter 10 are not shown, those of ordinary skill in the art will 
appreciate that such components and the interconnection 
between them are well known. Accordingly, additional 
details concerning the internal construction of the personal 
computer 10 need not be disclosed in connection with the 
present invention. 

Those skilled in the art will understand that program 
modules such as an operating system 36 and application 
programs, such as an interactive electronic map application 
37, are provided to the personal computer 10 via computer- 
readable media. In the preferred computer, the computer- 
readable media include the local or remote memory storage 
devices, which may include the local hard disk drive 20, 
floppy disk 23, DVD/CD-ROM 26, RAM 17, ROM 16, and 
the remote memory storage device 33. In the preferred 
personal computer 10, the local hard disk drive 20 is used to 
store data and programs, including the interactive electronic 
map 37. During user operation of the preferred computer 10, 
data and programs can be retrieved from the local hard disk 
drive 20 and are stored in local memory, such as RAM 17. 

Turning now to FIGS. 2-5B, an exemplary embodiment 
of the present invention is described via the conventional 
software illustration tools of representative display screens 
and logical flow chart diagrams. FIG. 2 is a display screen 
showing the graphical user interface (GUI) component 40 of 
an exemplary embodiment of the present invention. 
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Although this embodiment utihzes a scalable geographic 
map, those skilled in the art will recognize that the present 
invention can be utilized with other electronic forms of 
graphical content, such as road maps, animation, 

5 photographs, etc. In this embodiment, media items, typically 
represented by icons 42 (or "thumbnail" versions), are 
displayed when a position indicator, shown as cursor 44, is 
moved proximate to certain locations on an electronic geo- 
graphic map 46. These icons 42 notify the user that media 
items are associated with predetermined coordinates or 
"locations** on the map that are proximate to the position of 
the cursor 44. The icons 42 further provide the user with a 
visual object to select with the "click^' of a mouse button (or 
another conventional mechanism) to obtain direct access to 
the content of the associated media items. All map locations 

^5 are not necessarily associated with media items. For 
example, if the user moves the cursor 44 to a new location 
on the electronic map, the icons 42 displayed proximate to 
the old location will eventually disappear or fade after a 
pre-dctermincd period of time. If content is associated with 

20 the new location, however, new icons will appear proximate 
to the new cursor position. 

The exemplary geographic map 46 of the globe is scalable 
and can show fine levels of geography, such as individual 
cities and towns. The user may interact with a displayed 

25 icons 42 to gain access to further information regarding the 
subject of the displayed icon. For example, the user can 
quickly see what media items, if any, are available at a 
chosen location by moving the cursor over an area of the 
map 46 proximate to that location. For visual media, the user 

3Q is presented with icons 42 or "thumbnail" versions of the 
available media items associated with one or more locations 
proximate to the position of the cursor 44. In addition, as the 
geographic map is scaled upwards or downwards, the num- 
ber of locations (that are associated with media items) are 

35 reduced or increased respectively. Thus, the user will be 
presented with a larger number of media items when the map 
46 is scaled to show finer detail and will be presented with 
a smaller number of media items when the map 46 is scaled 
to show a lower level of detail. This prevents the map 46 

4Q from becoming visually cluttered or crowded and thereby 
confusing the user during interaction with the map 46. 

The exemplary embodiment of FIG. 2 can allow a user to 
restrict the media to be presented to different types and 
categories of media through the use of a media menu 50 with 

45 the listed media categories 53. Representative media cat- 
egories include images relating to people, places, 
landscapes, agriculture and industry and animals; audio 
media relating to national anthems and music of the world; 
and visual media representing national flags. It will be 

50 appreciated that the present invention can be extended to 
include any and all types of visual and/or audio media. To 
exercise this option, the user chooses the desired media 
category or categories by using an input device, such as a 
mouse, to select an icon 52 and thereby open the media 

55 menu 50. Thereafter, the user may use an input device to 
choose the particular category or categories of media to be 
retrieved when interacting with the geographic map 46. 

In FIG. 2, a user has restricted the categories of media to 
"images" by selecting this category on the media menu 50. 

60 The user has also used an input device, such as a mouse, to 
find locations associated with images by placing the cursor 
44 over a position on the geographic map 40. In response to 
the user input, media icons 42 representing all images 
associated with locations proximate to the cursor are dis- 

65 played to the user. 

FIG. 3 is a display screen showing the GUI 40 of an 
alternative exemplary embodiment of the present invention. 



04/20/2004, EAST Version: 1.4.1 



us 6,714,215 Bl 

7 8 

In this view, a user has restricted the type of media to be diagram. In this embodiment, the user selects the electronic 

presented to all "images" by selecting that category from the map program for operation. The \iser may then select 

media categories 53 listed on the media menu 50. The user whether or not to filter retrievable media items in step 76. 

has also passed the cursor 56 over the map to a position that The user then chooses whether to move a position indicator 

is proximate to locations associated with images. In 5 or pointer, such as a cursor, over the electronic map by use 

response to this user input, the user is presented with icons of an input device in step 78. A determination is made as to 

58 representing images (the restricted media category) asso- whether the cursor has been moved proximate to locations 

ciated with the locations proximate to the cursor 56. on the map that are associated with media items in step 82. 

In the exemplary embodiment shown in FIG. 3, there are If the cursor is moved to a point that is associated with 

multiple visual media items associated with the locations media, media icon windows appear on the map in step 84. 

proximate to the cursor 56 that have associated media items. If no media items are associated with the cursor location, the 

Only a single icon 59 can be presented for each specific user can continue moving the cursor until it contacts such a 

location in a reduced-pixel or "thumbnail" format due to the location in step 78. In step 86, a determination is made as to 

limited size of the geographic map 46. In order for the user whether there are multiple media items associated with the 

to be presented with all icons for available media, icons locations proximate to the cursor. If so, the icons of the 

representing the pertinent media items at the same location various media items are cycled in step 88. After the icons 

on the geographic map are consecutively displayed to the ^^^y^ ^^.^jj displayed and/or cycled, the user may choose to 

user. This process of scroUing among the available icons at ^^^^^ ^ displayed icon 90. Otherwise, the user may 

an electronic map locaUon is referred to as "cycling " Thus, ^^^^^^^ ^^^^ ^^^^ ^^^^ ^^^^^ electronic map in step 

an icon represenUng each additional media item that ^ 82 or elect to exit the computer-implemented process in step 

available for the locations proxunate to the cursor 56 will 20 r r r 

cycle in the same icon window 60 as the initially displayed * , , j* 

icon 59 selects a displayed icon in step 90, the media 

As shown in HG. 3, the user has moved the cursor 56 so ""J^"^^' f °P^"^^ f ^ presented to the user. The user then 

as to contact one of the presented icons 59. The user has has several opUons from withm the media viewer 92. The 

further selected the icon 59 by way of user input, such as a is ^^^^^ ^^^^^ additional media associated 

mouse click, so as to be given direct access to a full-size with the directly accessed media by exccutmg available 

display of one of the media items 62 represented by the icon hyperlinks in step 94 and thereafter exits the process in step 

59. Tb provide such access, an additional window (or media 102. The user also can elect to display an expanded version 

viewer) 64 is opened and displays the full-size image of the of the media item, if one is available, in steps 96 and 104. 

media item 62 therein. In this embodiment, the location 3Q The user can elect to scroll the other media items contained 

associated with the media item 62 is also associated with within the media viewer in step 98 and to display such media 

additional media items. Upon selection of the icon 59, one items within the media viewer in step 106. The user can elect 

of the media items 62 represented by the icon is arbitrarily to play audio media in steps 100 and 108. After each of these 

selected and displayed in the media viewer 64. Also, the user choices, the user can close the media viewer 92 in step 110 

can access all other media items associated with the map 35 or return to one of the media viewer options from step 92. 

location and that are cycled in the icon window 60 by If the user closes the media viewer in step 110, the user can 

selecting among the icons 66 associated with those other either exit the process in step 112 or return to move the 

media items from a scrolling list 68 of icons 66 within the mouse over the map to a new location in step 78. 

media viewer 64. In order to access the additional media Another exemplary embodiment comprises two 

items, the user can contact the desired media item's icon 66 computer-implemented tasks or sequences that operate 

with the cursor 56 and select the media item through a simultaneously (through multi-tasking) to identify and 

mouse click. retrieve media items for viewing and/or access by a user 

Through the media viewer 64, the user is able to execute interacting with an electronic map. The first sequence, which 

a hyperlink 70 and display an expanded version of the visual relates to the "interface" or the interactive point-and-click 

media item. For example, the user can jump to a expanded 45 activity by the user, is referred to as the "interface thread." 

version of a visual media item that could include such things The second sequence, which relates to the actual retrieval of 

as explanatory text, related text articles or further hyperlinks media items for viewing and/or access by the user, is 

to related information. As shown in FIG. 3, where the referred to as the "retrieval thread." 

caption 72 of the chosen media item is lengthy, the media The interface thread acts to identify locations over which 

viewer 64 allows for a scrolling list 74 so that the user can 50 the user has passed his cursor for which media items are 

view the entire description. In addition, the caption 72 of the available. The interface thread then passes this information 

chosen media item may contain additional hyperlinks. to the retrieval thread. The retrieval thread acts to retrieve 

As can be seen in FIG. 2, the present invention can be the available (and pre-selected) media items for viewing 

configured so as to present a user with various types of and/or access by the user. By allowing these threads to 

media 53 for a selected graphical content, such as an ss operate simultaneously, the invention allows the user to 

electronic map. These media types typically include photo- move quickly from point to point on the geographic map and 

graphic or animated visual media, textual media, audio to quickly identify the media items available at each point, 

media and computer-generated graphic visual media. In the This exemplary embodiment further acts to provide the 

case of audio media, the user can be presented with such perception to the user that media items are available quickly 

media through the use of icons, which allow a user to direct 60 from multiple locations on the geographic map and that 

access the content of the audio media through a audio media items are available quickly from the scrolling icon list 

playback device contained within the media viewer 64. In 68 of the media viewer 64. This perception is provided 

the case of other types of audio media, a user also can be through the order of execution of the processing steps 

presented in either icon or thumbnail versions and accessed associated with the retrieval thread. Specifically, the 

through the media viewer 64, 65 retrieval thread acts to retrieve media items by dividing 

IVming now to FIG. 4, an exemplary embodiment of the media locations identified by the interface thread into four 

present invention is shown in the form of a logic flow categories: 
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(1) locations for which no media items have been 
"fetched" into memory; 

(2) locations for which one or more media items have 
been "fetched" into memory; 

(3) locations for which all available media has been 5 
fetched into memory; and 

(4) locations within the media viewer. 

The retrieval thread normally assigns first priority to 
category 1 locations for the puipose of media item retrieval 
and second priority to category 2 locations. Specifically, the lO 
retrieval thread will fetch at least one media item into 
memory for all locations in category 1 before it fetches 
additional items into memory for category 2 locations. Once 
all category 1 locations have at least one media item 
retrieved (i.e., all category 1 locations have been converted 15 
into category 2 locations) the retrieval thread will load one 
additional remaining media item, if any, for each category 2 
location. The retrieval thread then reassesses all media 
locations. After all media items have been fetched into 
memory for all category 2 locations (i.e., all category 2 20 
locations have been converted into category 3 locations), the 
retrieval thread will pause for a pre-selected time period to 
allow more processing time for the interface thread. This 
process will then start again after the pre-selected time 
period has expired. 25 

In addition to locations on the geographic map, the 
retrieval thread also interacts with the media viewer 64 to 
provide the perception to the user that additional media 
items 66 are available quickly from the scrolling icons list 68 
of the media viewer 64. If a user selects a media icon 59 and 30 
thereby opens the media viewer 64, the retrieval thread will 
assign first priority to category 4 locations, i.e., those media 
locations on the scrolling icon list 68. 

An exemplary embodiment also supports varying con- 
figurations of the interface thread to provide the perception 35 
of greater responsiveness and speed to users that utilize 
computer systems with slower processing speeds. 
Specifically, the interface thread identifies locations with 
which media items are associated. In one exemplary 
embodiment, the locations are defined by a rectangular area 40 
of a pre -set number of pixels centered at the position of the 
cursor. If the interface thread determines that a particular 
central processing unit has a relatively fast or slow process- 
ing speed, the system will increase or decrease the size of the 
pixel area associated with the available locations on the 45 
geographic map and identified by the interface thread. For 
example, the processing steps associated with the interface 
thread can reduce the size of the rectangular pixel area 
centered on the cursor. Thus, the interface thread will order 
the retrieval thread to fetch fewer media items with respect 50 
to a given cursor location, providing the user with the 
perception that the system is faster and more responsive. 

T\iming now to FIGS. 5 A and 5B, logic flow diagrams are 
used to illustrate the exemplary operations of the interface 
and retrieval threads 116 and 114. The interface thread 116 ss 
is started when a user moves the cursor over the electronic 
map in step 117. The interface thread 116 first determines 
whether the user's CPU has a relatively slow processing 
speed in step 118. Then the interface thread 116 either 
creates a one inch (1 ") square rectangle or cursor block to be 60 
centered around the cursor in step 120 or it creates a smaller 
cursor block in step 122. 

Next, the interface thread 116 determines whether there 
are any map locations contained within the cursor block 
surrounding the cursor's current position that are associated 65 
with media items in step 124. If not, the interface thread 116 
waits until the cursor is moved to a new location in step 126. 



If the cursor is so moved, the interface thread 116 restarts at 
step 117. If, in step 124, the interface thread 116 detects 
locations with associated media items, the interface thread 
116 then verifies whether it has previously checked to see 
which specific media items are associated with such loca- 
tions in step 128. The interface thread 116 then creates 
and/or continually updates a list of map locations that have 
been previously checked for media items and for which the 
associated media items have been identified in step 130. In 
step 132, the interface thread 116 analyzes the media items 
associated with the map locations within the cursor block. In 
step 134, the interface thread 116 determines whether any of 
the pertinent media types fit within the user-selected media 
categories. If the interface thread 116 determines that there 
are no such media, it returns to step 126 and waits for the 
user to move the cursor to a new location. If the interface 
thread 116 does detect such media in step 134, it creates a 
list of media identifiers that are associated with each of the 
locations contained within the locations list in step 136. 

Following step 136, the interface thread 116 then deter- 
mines whether there is an available icon window proximate 
to the current location of the cursor in which to display a 
representation of the media item(s) in step 138. If there is no 
such an icon window, the interface thread 116 then creates 
an icon window (or windows) in step 140. If there is an 
available icon window (or if one has been created), the 
interface thread 116 associates the pertinent map locations 
with the nearest available icon window(s) in step 142. In 
step 144, the interface thread 116 accepts input from the 
retrieval thread 114 as to which media items have been 
retrieved into memory. In step 146, the interface thread 116 
updates the icon windows media list to reflect the presence 
of the newly retrieved media items. The interface thread 116 
then determines more than one media item has been 
retrieved via a relevant icon window in step 148, If not, the 
single media item is displayed in the pertinent icon window 
in step 150. If so, the multiple media items are cycled in the 
pertinent icon window in step 151. At this point, the inter- 
face thread 116 returns to step 126 until the user moves the 
cursor to a new location. 

Simultaneously with the execution of the interface thread 
116, the retrieval thread 114 begins retrieval operations. In 
step 152, the retrieval thread 114 begins when the user 
moves the cursor to a new location on the map. The retrieval 
thread 114 then checks the media locations list in step 154 
and the media identifiers list in step 156 in order to deter- 
mine whether there are any media items that need to be 
"fetched" into memory from data storage in step 158. If no 
media needs to be retrieved, the retrieval thread pauses for 
a pre-selected period of time, such as 250 milliseconds, in 
step 160 before returning to step 154. If such media items do 
need to be retrieved, the retrieval thread 114, in step 162, 
reviews the category status of each map location that has 
been added to the map locations list by the interface thread 
116. In step 163, the retrieval thread 114 determines whether 
any category 4 locations are present. If so, the retrieval 
thread 114 sequentially retrieves each media item for each 
location in category 4 in step 164. If not, the reu-ieval thread 
114, in step 165, determines whether each location in 
category 1 has a retrieved media item. If not, in step 166, the 
retrieval thread 114 retrieves one media item for each 
location in category 1, In step 167, the retrieval thread 114 
updates the list of retrieved media items for later use by the 
interface thread 116. In step 168, the retrieval thread 114 
updates the list of map locations as to whether associated 
media items have been retrieved. 

In step 170, the retrieval thread 114 notifies the interface 
thread 116 as to which media items have been retrieved into 
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memory. The retrieval thread 114 then returns to step 162 
and reassesses the category status of the identified media 
locations. Alternatively, if the retrieval thread 114 deter- 
mines in step 165 that each category 1 location has had one 
media item retrieved, it retrieves one additional media item 
for one category 2 location in step 172. In steps 174, 176 and 
178, the retrieval thread 114 updates the media location list 
and the media identifier list and aotifies the interface thread 
116 of this new information. In step 180, the retrieval thread 
114 determines whether there are any remaining category 2 
or category 4 locations. If so, the retrieval thread returns to 
step 162. If not, the retrieval thread 114, in step 182, pauses 
for 250 milliseconds and then returns to step 154. 

In view of the foregoing, it will be understood that the 
present invention is directed to a computer-implemented 
method for interactively presenting media items associated 
with an electronic content presentation, such as a graphical 
user interface (GUI), via an output device. A determination 
is made whether a position indicator or pointer, such as a 
cursor, is located proximate to a GUI location that is 
associated with supplemental content in the form of a media 
item. If so, an indicator is presented to advise the user that 
supplemental content is indeed associated with that location 
on the interface. For example, a media icon representing one 
or more media items can be displayed on the output device 
proximate to the location of the input device indicator. This 
indicator serves as a prompt or cue for the user to select the 
indicator if the user desires to review the supplemental 
content. A determination is made whether the media icon has 
been selected in response to an input signal issued by an 
input device. If so, the selected media item, typically video 
and/or audio information, is presented to the user via the 
output device. 

The present invention has been described above in rela- 
tion to particular embodiments that are intended to be 
illustrative rather than restrictive. The particular embodi- 
ments described involve the use of a geographic electronic 
map. However, those skilled in the art will understand that 
the principles of the present invention apply to any task or 
process that requires interactivity between with an electronic 
content display and content items associated with locations 
for that content display. Alternative embodiments will 
become apparent to those skilled in the art to whom the 
present invention without departing from its spirit and 
scope. Accordingly, the appended claims rather than the 
foregoing description define the scope of the present inven- 
tion. 

What is claimed is: 

1. A method for interactively presenting one or more 
media items providing supplemental content for a graphical 
user interface (GUI) that supports the presentation of pri- 
mary content via an output device, comprising the steps of: 
determining whether a position indicator is located proxi- 
mate to a location on the GUI, the location associated 
with one of the media items; 
if the position indicator is located proximate to the 
location associated with one of the media items, then 
displaying an indicator representing the media item 
associated with the location of the position indicator by 
cycling through a visual presentation of the indicator, 
the indicator providing an indication that supplemental 
content supported by the media item is available for 
presentation in connection with the location; 
determining whether the indicator has been selected in 
response to receipt of an input signal issued by an input 
device; and 

if the indicator has been selected, then presenting the 
supplemental content for the media item corresponding 
to the selected indicator via the output device. 
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2. The method of claim 1 wherein the step of determining 
whether a position indicator is located proximate to a 
location on the GUI comprises identifying whether the 
position indicator has entered a predetermined threshold 
boundary positioned proximate to and sounding the location. 

3. The method of claim 2, wherein the predetermined 
threshold boundary is defined by a rectangular area centered 
about the coordinates of the GUI location. 

4. The method of claim 2, further comprising the steps of: 
determining the relative processing speed of a computer 

system for presenting the GUI; and 
adjusting the size of the predetermined threshold bound- 
ary based upon the relative processing speed of the 
computer system. 

5. The method of claim 1 wherein the indicator repre- 
senting the media item comprises a reduced-pixel display 
image for presentation via the output device. 

6. The method of claim 1 wherein the step of presenting 
the media item comprises displaying a digital photographic 
image via a window fame rendered on the output device. 

7. The method of claim 1, further comprising the steps of: 
assigning the media items to one of two categories 

representing types of supplemental content; and 
determining whether at least one of the categories is 
selected; and 

if at least one of the categories is selected, then displaying 
the indicator only if the indicator is associated with one 
of the media items in the user-selected category. 

8. The method of claim 1, further comprising the step of 
terminating a presentation of the indicator representing the 
media item after the position indicator is moved away from 
the location and upon expiration of a predetermined time 
period. 

9. The method of claim 1, wherein the GUI is scalable and 
further comprising the step of adjusting the number of 
locations that support the presentation of the indicator 
representing one of the media items based on the adjusted 
scale of the GUI. 

10. A computer-readable medium having computer- 
executable instructions for performing the steps recited in 
claim 1. 

11. A method for identifying and retrieving one or more 
media items for the purpose of presenting said media items 
upon an output device, comprising the steps of: 

displaying a GUI comprising an electronic geographic 
map upon the output device; 

determining whether a position indicator is located proxi- 
mate to a first location on the electronic map, the 
location associated with at least one of the media items; 

if so, retrieving a media item associated with the first 
location into a memory storage device; 

determining whether the position indicator is proximate to 
at least one additional location on the electronic map, 
the location associated with one of the media items; 

if so, identifying all locations proximate to the position 
indicator; 

assigning each identified location to status categories 
consisting as follows: 

category 1: no media items associated with the location 

have been retrieved; and 
category 2: at least one media item associated with the 

location has been retrieved; 
retrieving at least one of the media items for each location 
in category 1; 

retrieving at least one of the media items for each location 
in category 2; 
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reassigning each identified location to the appropriate 
category upon retrieving each media item associated 
therewith; and 

restarting the steps of identifying and assigning locations 
and retrieving the media items upon determining that 
the position indicator is proximate a new location on 
the electronic map. 

12. The method of claim 11, further comprising the steps 

of; 

assigning the media items to one of two categories 
representing types of supplemental content; 

determining whether at least one of the categories is 
selected; and 

if at least one of the categories is selected, then retrieving 
only those media items assigned to the user selected 
category. 

13. A computer-readable medium having computer- 
executable instructions for performing the steps recited in 
claim 11. 

14. A method for interactively presenting one or more 
graphical media items providing supplemental content for a 
graphical user interface (GUI) that supports the presentation 
of primary content, comprising the steps of: 

determining whether a position indicator is located proxi- 
mate to a location, the location associated with a 
plurality of the media items; 

if the position indicator is located proximate to the 
location associated with the plurality of media items, 
then displaying a plurality of graphical media indica- 
tors for the plurality of media items associated with the 
location of the position indicator by cycling through a 
visual presentation of the plurality of graphical media 
indicators, each graphical media indicator providing an 
indication that supplemental content supported by each 
media item is available for presentation in connection 
with the location; 
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determining whether at least one of the plurality of 
graphical media indicators has been selected in 
response to receipt of an input signal; and 

if at least one of the plurality of graphical media indicators 
^ has been selected, then presenting the supplemental 
content for the media item corresponding to each 
selected graphical media indicator. 

15. The method of claim 14, wherein the position indi- 
cator and at least one of the plurality of graphical media 
indicators are displayed at the same time. 

16. The method of claim 14, wherein the step of deter- 
mining whether a position indicator is located proximate to 
a location comprises identifying whether the position indi- 
cator has entered a predetermined threshold boundary posi- 
tioned proximate to the surrounding location. 

17. The method of claim 16, wherein a first area for the 
predetermined threshold boundary is greater than a second 
area for the location associated with the plurality of media 

20 

18. The method of claim 14, wherein at least one of the 
plurality of graphical media indicators representing the 
plurality of media items comprises a reduced-pixel display 
image for presentation via an output device. 

19. The method of claim 14, further comprising the steps 

of: 

assigning at least one of the pluraUty of media items to a 
first category and a second category representing types 
of supplemental content; 
30 determining if the first category or the second category is 
selected; and 

if one of tile categories is selected, then displaying each 
of the plurality of graphical media indicators associated 
with one of the media items assigned to the selected 
category. 
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